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Increasing Data Transmission Bit Rates 

This invention relates to signal transmission systems, and in particular, to 
systems in which a continuously transmitted signal carries a series of discrete voltage 
levels. Thus it may be applied to communication systems or to any other system in 
which a multi-level input passes through a signal path having the characteristics of a 
finite response (FIR) filter. Such a system is referred to herein generally as an "ISI 
channel" 

In conventional digital data transmission systems, signals are usually transmitted 
in a "binary" scheme, that is to say as two discrete voltage levels. However, it is possible 
to increase the data rate over a given channel, by transmitting higher order 
constellations, in which, instead of two distinct voltage levels, several voltage levels are 
used. 

A communication system can be divided into three basic elements: transmitter, 
channel and receiver. The second element - the channel is the one that determines the 
upper limit of the communication bit rate. For binary transmission (e.g. transmission of 
+1 V and -1 V), when the bit rate is close to the channel bandwidth, internal noise is 
introduced. This noise, which is responsible for the upper limit on the bit rate, is called 
ISI (Inter Symbol Interference). Under the "ISI noise" the received bit voltage level is the 
sum of a scaled transmitted bit level plus noise, which is a linear combination of the 
surrounding bits of the received bit. Once the channel characteristics are known an 
inverse operation can be done, at the receiver, to minimise the ISI noise effect. 

When the transmission rate is low enough (no ISI effect), the bit rate can be 
increased by transmission of higher order constellation. Then instead of a binary 
transmission the transmitter can send one of several different voltage levels each 
representing a symbol. In general, 2 n constellation order transmission, where every 



symbol carries n bits, has n times higher bit rate than in the binary transmission. The bit 
rate can be thought as the area of a rectangle, where one axis is the symbol rate and the 
other axis is the log2 of the constellation size (voltage axis). 

Normally a training sequence is initially sent to the receiver. This training 
sequence, in effect, provides the receiver with information about the channel 
parameters. 

Unfortunately, however, the use of a training sequence implies a delay before 
proper transmission can begin, and if the nature of the communication channel changes 
frequently, as is the case (for example) in the case of mobile telephone systems, it is 
necessary to repeat the training sequence regularly, which slows down the total possible 
rate of data communication, so requiring a wider bandwidth or lower bit rate. Also, in a 
situation where a receiver begins to receive a transmission which has already started 
(e.g. digital TV), the training sequence will not necessarily be available. 

Accordingly, the present invention seeks to provide a method of enabling high 
order constellation communication, without lowering the symbol rate, by evaluating the 
channel characteristics without the use of a specific training sequence. 

High order constellation communication through ISI channels has the property that 
the ISI noise effect is much larger than at lower order constellation. The high order 
constellation acts in effect, as an amplifier on the basic binary ISI noise level. This high 
level noise prohibits the estimation of the channel characteristics under high order 
constellation in known systems. 

Accordingly, .the present invention provides a method of high order constellation 
signal transmission through an ISI channel, by identifying "reliable symbols", that is to 
say symbols which are closer to their received constellation points (i.e. their scaled 
transmitted symbols free from ISI noise effect symbols) than to any other received 
constellation point. The constellation may be of any size and the channel may be up to 
the binary open eye channel limit 
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( £ |/|<1). 

ie/S/ 

Since the ISI noise results from a combination of the ISI coefficient values and the 
surrounding symbols, the method of the invention preferably comprises identifying a 
5 symbol having surrounding symbols of a relatively lower level, up to some predetermined 
distance before and after the identified symbol, nominating the identified symbol as a 
"reliable symbol", and repeating the process a number of times along the received signal 
sequence, in order to gather a sufficient number of reliable symbols to enable a proper 
evaluation of channel characteristics to be achieved. 
1 0 Preferably, therefore the method of the invention includes the step of estimating 

the constellation points location, so as to establish the channel gain, and then estimating 
the ISI coefficients so that a suitable inverse operation can be carried out in order to 
minimise the ISI noise. 

One embodiment of the invention will now be described by way of example, with 
15 reference to the accompanying drawings in which: 

Figure 1 is a functional block diagram of the method of the invention; 
Figure 2 is a diagram illustrating a first sequence of transmitted symbols; 
Figure 3 is a diagram illustrating a second sequence of transmitted symbols; 
Figure 4 shows a 256 QAM signal constellation; 
20 Figure 5 shows the algorithm for constellation points location estimation; and 

Figure 6 shows the algorithm for channel parameters (ISI coefficient) estimation. 
Referring to Figure 1, a signal constellation 4 is applied to a QAM modulator 2 so 
as to produce an output which is applied to an ISI channel 6. The resultant transmitted 
constellation after demodulation, as indicated at 8, consists of constellation points which 
25 have been shifted by the ISI channel, and the output from the demodulator 10 is applied 
to a reliable symbols extractor 12 which produces two outputs. One output, indicated at 
14, consists of the extracted reliable symbols, whilst the other output 16 consists of the 



related surrounding symbols for each reliable symbol, and these two signals are applied 
to a channel parameter estimator 18. This in turn produces two parallel outputs, one 
output 20 consisting of ISI coefficients, whilst the other output 22 consists of the actual 
constellation points. 

These two outputs 20 and 22 are applied to the input of an inverse channel filter 
24, another input of which receives the output of the demodulator 10 directly, on line 26. 
Consequently, the inverse channel filter is able to produce a corrected symbols 
constellation 28, by applying the derived inverse channel characteristics to the symbols 
constellation received on line 26. 

The principle of operation of the reliable symbols extractor is illustrated in Figures 
2 and 3, each of which illustrate a series of transmitted and received symbols. 

Referring to Figure 2, this illustrates the transmission of a series of different 
symbols 30, 32 .... 40, 42, having voltage levels +11, -5, +7, +7, +11, -3, and +13 
respectively. Thus each different transmitted symbol, in the case illustrated, is 
represented by a different voltage level, the voltage levels being separated by two volts, 
the maximum being 13 volts. 

A received central symbol is illustrated at 44, and it will be seen that this has an 
amplitude of just under 13 volts, but this amplitude is not likely to be "reliable", because 
the surrounding symbols 30, 32, 34 and 38, 40, 42 are of relatively high amplitude, and 
in fact, of course, the received symbol 44 really represents the transmitted symbol 36 but 
has a considerably greater apparent amplitude. 

By contrast, Figure 3 illustrates the situation in the same ISI channel, where a 
series of low amplitude transmitted signals, 46, 48, 50, 52, 54 and 56 surround a 
relatively high amplitude signal (7V) 58. In these circumstances, the received symbol 60 
is much closer in amplitude to the signal 58 than any other possible constellation point, 
because the inter symbol interference is at a lowerjevel, as a result of the lower 
amplitudes of the surrounding symbols. Thus it is identified as a reliable symbol 
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Since the ISI channel can be characterised by a channel gain and a series of 
coefficients operating on the symbols surrounding the "reliable symbol", the channel 
characteristics can be derived if a sufficient number of reliable symbols can be identified. 

Figure 4 shows (by way of example) a 256 QAM signal constellation. 

Figure 5 shows the algorithm for constellation points location, while Figure 6 shows 
the algorithm for channel parameter estimation. The following analysis presents a model 
for the noise that is generated from the combination of ISI and high order constellation. 



Model of the noise 1 under ISI and high 
order constellation 



To present the "Reliable Symbols" theorem and the following different estimation 
methods, a model for the noise that is generated from the combination of ISI and high 
order constellation is derived. 

The Standard Deviation (STD) of the ISI noise under high order constellation is: 
£W ) = E(Z Xi ■ m^f = E( "z £ Xi ■ XJ . ISIi _ n . ISIj _ n ) 

i=n~b i-n-b j-rt-b 

where x „ is a transmitted symbol, i.i.d with uniform distribution, and ISI„ is an ISI 

coefficient. 

Then , 

iW)= ^Etf =E(x 2 ). £ /lS 7,_„ 2 = ax *-[rSlf (2.1) 

i-n-b i--b 

Easy to show that E(jn isi ) = 0 . 

Eq.(2.1) shows that the high order constellation is acting in effect as an amplifier on 
the basic STD of the ISL Fig. (2 J) shows the STD of the ISI noise effect as a function 
of the size of the constellation. We'll use the pdf derivation of the sum of independent 
random variables [1] to find the pdf for a weighted sum of independent identical 
uniform distribution variables. For the weighted sum: 

nisi = UlSIi-n x„ : / g [n - b y n + /],/ ^ n 
the characteristic function of n ? si , is: 

Q>„Jo ) = E{e imn "»>) = E(e ' *') = E(e ISI -^-" ) . • • E(e ISI ''*'") 

iid (2.2) 



1 We refer as "noise" to the ISI effect on the signal. AWGN refers to the gaussian noise 



where Xi = ISh- n * xt . 

Based on the property that the characteristic function is the Fourier transform of the 
pdf function /, the pdf of m S i is: 

f(n isi ) = fxx*fx2*'-* fx2k = fUSI-k ' x) * fUSI-^x ■ x) * • ■ ■ * /(/S/* • x) (2.3) 
For the case where all the ISI coefficients are identical, the pdf of n isi is fc-l 
convolution of identical rectangular windows. When the ISI coefficients are not 
identical it's easy to show that the pdf of n isi is identical, in the second derivation 
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Figure 2.1: STD of the ISI effect as a Junction of the constellation size. f||/-S7|| 2 =1) 

sign and similar in shape, to the pdf with identical coefficients. f(m S i) becomes 
closer to the pdf of the gaussian process as a function of k (in a finite size range). 
Fig.(2.2) shows the pdf of m S i for ISI with fe=3 where the coefficients are identical 
and as a comparison the gaussian distribution. Notice that while the central limit 
theorem [1] ensure that f(n IS i) has a gaussian pdf for infinite fc, as low as k=3 where 

the pdf of msi is a function of ± x 2 (minus for the central part) f(n lsi ) is already very 
close to the gaussian pdf 

Defining the range of magnitudes in each axis of the constellation to be unity, a 
uniform discrete distribution of the constellation points are dense enough, at high 



order constellation, to be considered as continues uniform distribution. This means 
that the noise produced by high order constellation, uniform distributed 
communication, through an ISI channel can be modelled as a gaussian noise with zero 
mean and variance as in Eq.(2. 1). 

This gives the ability to use the SNR to model the noise level of the combine ISI - 
high order constellation, using the same scale as for the gaussian case. 
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The SNR as a function of the ISI and the constellation size, is then: 
'-Idb 16QAM 

1 



SNR= 



-Udb 64QAM 
-\9db 256QAM 
-25dB 1024QAM 



+101og- 



(2.4) 



Eq.(2.4) emphasise the high level of ISI noise caused by the high order constellation 
"amplifier effect". In the next chapters we use the properties of the ISI- high order 
constellation noise that were developed in this chapter. 
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"Reliable Symbols" theory and Channel 
Parameters Estimations 



Abstract 

Blind detection under high order constellation and Intersymbol Interference (ISI) 
channel is a desired capability. Enabling high order constellation communication 
without lowering the symbol rate enables higher bit rate, for very important present 
and future communication scenarios. Examples for such scenarios are: one receiver 
for several transmitters, mobile phones and digital TV transmission. High order 
constellation is shown to have an amplifier effect on the level of the ISI channel 
affect. We present a new method, the <e Reliable Symbols" method, which enables 
estimation of the channel parameters and the received constellation points under high 
order constellation and ISI channel. Based on these estimations, successful detection 
can be done using non-blind methods. 

The "Reliable Symbols" method enables to identify received symbols that are closer 
to their constellation points, than to any other constellation point. An estimation of the 
received constellation points (the product of the transmitted constellation points and 
the channel gain) based on the "Reliable Symbols" method is presented. Using in 
addition to the reliable symbols, the surrounding symbols of every reliable symbol, an 
estimation of the channel parameters is presented. The cc Reliable Symbols" method 
enables estimation for channels up to the binary open eye level ( £|ZS7/| < |/37 0 |), 

while there is no limit on the constellation size. Simulations confirm the '"Reliable 
Symbols" method and the related estimations to be successful under channels up to 
the binary open eye level and for constellation up to at least 1024QAM. 



4.1 Introduction 



In this chapter a new method that enables successful parameters estimations under 
high order constellation communication through Intersymbol Interference (ISI) 
channels, is presented. 

Channel bandwidth limitations motivate the use of high order constellation 
communication, which enables high bit rates. High order constellation communication 
through ISI channel, as it is shown, has a very high ISI noise effect, where the 
constellation size is acting in effect as an amplifier on the ISI noise level. Blind 
detection, which is based on channel parameters estimations, has been therefore a 
very difficult, if not impossible, task for high order constellation communication 
[1],[2]. Normally blind detection for high order constellation is done using blind 
equalization. Blind equalization is a mechanism that finds and implements the inverse 
filter for the channel impulse respond, which minimise some cost function. The cost 
functions that are involved depend on the statistics of the transmitted symbols. The 
simplest blind equalizer is the Reduce Constellation Algorithm (RCA) [1],[3]. The 
cost function minimised by the RCA is the Minimum Square Error (MSE) with 
respect to a reduce number of symbols, which normally are not a subset of the 
constellation points. The RCA is suitable for constellation size up to 32 points [1]. 
The most common equalization method is the Constant Modulus Algorithm (CMA) 
[4],[5],[6]. The cost function minimised by the CMA is the dispersion of the output of 
the equalizer around a circle. The CMA main advantage is that it does not requires 
carrier frequency recovery. The CMA is suitable for constellation size of up to 64 
points [1]. The MultiModulus Algorithm (MMA) [l],[7j, is based on the CMA but 
acts on each axis, in the QAM constellation, separately. The (MMA) is suitable for 
constellation size of up to 128 points [1]. The General MMA (GMMA) [1] is the 
latest algorithm, which in principle divides the full constellation to subsets and 
minimise the MMA cost function according to each subset. The GMMA was shown 
to be suitable for constellation size of 256 points [1]. All the mentioned algorithms do 
not address the problem of the constellation size amplifier effect. Consequently they 
are optimal just for 4QAM or PSK. The minimum of the different cost functions raise 
with the constellation size, which 'make them unsuitable for use in common ISI 
channels where just low order constellation communication operates successfully. In 



addition the present algorithms require the knowledge of the transmitted points and 
the channel gain recovery. 

We present a new method, which identifies symbols that are less affected by the 1ST 
channel. The distances from their origin points, the received constellation 2 points, are 
less than half the distance of the nearest points in the received constellation. We call 
these symbols "Reliable Symbols", "Reliable" because the nearest constellation point 
to the received '"Reliable Symbol" is its origin point. The different parameters 
estimations use then the reliable symbols for the estimation process. Two applications 
of parameters estimation under high order constellation communication through ISI 
channel, based on reliable symbols are presented: 1) Estimation of the constellation 
points, the product of the transmitted constellation points and the channel gain, and 2) 
ISI coefficients estimation. The estimations are shown to be suitable even for time 
varying channels. These parameters estimations enable to successfully detect the 
received signal by using equalization or/and by soft decision methods [8],[9],[10]. It 
is shown that the upper limit on channel ISI level is Z|iXf/| = l (the binary 

modulation open eye channel condition, e.g. 4QAM), while there is no theoretical 
limit on the constellation size (estimation under up to 1024QAM is shown to be 
reliable by simulation). 

The estimation is blind, in the sense that no training sequence is used. The required 
length of the data sequence is a function of the length and level of the ISI, and the 
constellation size. 

Channel estimation using "Reliable Symbols" is suitable under variety of 
environments: Mobile phone channels where the ISI cc window" length is short (about 
four coefficients) can be recovered effectively in "real time" for moderate 
constellation sizes. Data transmission over the telephone line, even under very high 
constellation size or/and long ISI window, where by using data storage capability the 
channel parameters can be recovered. Digital TV and other applications using VDSL, 
where the very high symbol rates enables to recover the channel parameters even for 
very high constellations or/and long ISI windows, effectively in "real time". High 
order constellation in software radio [11], where the transmitter and the channel 
parameters has to be recovered [12]. 



2 Scaled transmitted symbols because of the channel gain. 



@ 12 
Channel and transmitter parameters estimations based on the ee Reliable Symbols 55 
method enable higher bit rate communication, by using higher order constellation, for 
a given limited bandwidth channel with symbol rate of up to the limit of the binary 
closed eye for 4QAM constellation. 

The chapter is divided into seven sections: After the Section 4.2 presents the "Reliable 
Symbols 5 ' theory. Section 4.3 presents the constellation points estimation. Section 4.4 
presents the ISI coefficients estimation. Section 4.5 presents adaptive estimation 
properties and Section 4.6 presents the simulation results and Section 8 contains the 
conclusions. 

The following notations will be applied: 
x n = Transmitted symbols at time n. 
y n = The related received signal of x„ 

\ISI\ - £ |ZS7,| 
/=-<> 

ISIo = 1 (Normalised ISI). 

i~—b 

7*0 

k=f+b (/"-forward, 6-backwards) 
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4.2 Reliable Symbols under high order constellation and ISI 



In the estimation process normally the data points are considered to have the same 
importance when they are following the same statistics laws. In high order 
constellation communication under ISI conditions, a fraction of the data points are 
closer to their origin points, their received constellation points, than to any other 
received constellation points (Ch. 2). Let us define the received pulses that are closer 
to their origin points than to any other received constellation points, as £c Reliable 
Symbols". The name, "Reliable Symbols", indicates that their metric from their 
closest received constellation points are the real metrics that are caused because of the 
channel noise. It is shown in the following sections, that knowing the right metric 
enables to recover or to estimate some key parameters in data communication as the 
ISI coefficients and the channel gain. 

The problem is to find these precious symbols. Finding the whole set of reliable 
symbols is a very difficult if not impossible task. Instead we'll find data points from 
the reliable symbols set, where this subset is normally a small fraction of the reliable 
symbol set. 

In high order constellation communication under ISI channel the metric of every 
received point depends on the ISI coefficients, the "future" and the "past" symbols 
(the surrounding symbols) and the adaptive gaussain noise: 

</„ = "zxrlSI^+n* (4.1) 

i-n~b 

where, {x} is the surrounding symbols sequence and n n is an Adaptive White 
Gaussian Noise (AWGN) process. 

For the moment let us assume high SNR so we can ignore the AWGN. Between the 
first two parameters x ( . and AS7„_, just the first, the surrounding symbols, can be 

considered as controllable. In general as the energy of the surrounding symbols are 
smaller the metric of a received data point from its origin point is smaller. Let us 
examine the case where the surrounding symbols have the same sign as the related ISI 
coefficients. In this case the metric is: 

dy m = "if |*,H/tf,-„| (4-2) 

i=n~b 

This situation is the "worst case" scenario, where the surrounding symbols fulfils: 



{xr- Y K|-|/^_„|<c/ Iim } 



i=n-b 



then, the metric of the related received data (the central symbol) from its origin point 
is ensured to be smaller than du m ■ 

Normally in blind detection the distribution of the ISI coefficients are not known. 
Therefore to ensure that symbols are under some reliable condition, the ISI is assume 
to be in the worst case, where its coefficients are distributed uniformly and equal the 
maximum one. Following a restriction on the sum of the absolute of the ISI noise: 

£K|<|/^/L (4 .3) 



/*0 



provides us with a criterion to find the reliable symbols. 

Criterion: A symbol is from the Reliable Symbol subset if (not if and just if) its 
surrounding symbols fulfils: 

' X/ '~j/§^ v/e r w -M + /L/«» (4.4) 

where d lim is half the distance between the two nearest received constellation points. 
The number of detected reliable symbols for a given d X{m is obviously a 
monotonically increasing function of the probability, 



'lim 



which is a monotonically increasing function of f*? . For a given d lim , the number 

of reliable symbols is a monotonically decreasing function of the constraint on the ISI. 
For further presentation of the reliable symbols theory we'll use the common QAM 
(or the similar CAP) as a demonstration vehicle. Furthermore, we assume that the ISI 
effect is orthogonal, the noise in I and Q directions is a function just of symbols from 
the I and Q sequences respectively (in 4.2.3 the case where the ISI have complex 
coefficients is treated). Let us define two units as the distance between two nearest 
transmitted symbols in the I direction (the same is for the Q direction). Then, 
according to the definition of the reliable symbols, a reliable symbol has a metric of 
up to one unit, ^i im =l, from its origin transmitted point. Then the maximum of the 
absolute of the ISI coefficients cannot exceed one. The proof is straight forwards: 



1 5 

From Eq.(4.4) maximum \ISI\ is abled when {x}, the surrounding symbols, have 



minimum magnitude, thus Then according to Eq.(4.4) when diim' 



= 1, 



imtn 



Notice that one as an upper limit to the ISI noise effect is the definition of an open eye 
in the binary scheme modulation which exist as an example in 4QAM and 2ASK. 
This enables us to define an engineering oriented sentence: 

Sentence; For channels where the binary modulation scheme has the property of an 
open eye, Reliable Symbols could be found for high order constellation 
communication. 

The open eye limit is not a hard limit. Even in the case where the ISI channel exceeds 
the open eye limit reliable symbols could be found, but in addition not reliable 
symbols, mistakenly, could be considered as reliable. This error effect increases as the 
|/iS7j increases. Conceptually it can be considered similar to the Error - Rate function 

[18] where the rate exceeds the capacity point, the error cannot be any more zero, and 
it is growing as a function of the rate. 

4.2.1 The probability to find a reliable symbol 

To have an indicator to the data sequence length that is required for the different 
estimation process based on the reliable symbols, we derive the probability function 
to find a reliable symbol. 

For the most general case where the only restriction is the open eye restriction, thus 
\ISI\ < 1 the probability to find a reliable symbol is: 



Pr = 2< 



\ISI\<1 (4.7) 



, V constellation , 

Proof: to ensure reliable symbol all the surrounding symbols must be from the lowest 
level of the constellation points, thus two points among the I (or Q) constellation 
points. This probability must be powered by the length of the ISI window to insure 
that every surrounding symbol that participates in the ISI effect is from the lowest 
points. The multiplication of two is because the points are gathered independently 
from both I and Q axes. 
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For lower upper limits to the absolute of the sum of the ISI, \ISI\ , the probabilities to 
find reliable symbols become: 

a. P R = 2 • f , 2 ) • (A + 1) : |/57| < 0.5 (4.8) 
const J ' 

It is easy to show that for the 0.5 limit, in addition to the first layer of points in the 
constellation, the surrounding symbols can be with one symbol from the second layer 
of the constellation points. 

For 0.33 limit, the surrounding symbols can be from both the first and second layer of 
the constellation points. 



c.P R = 2-- r ^= :W<0.25 (4.10) 

const J \^ const J 

For 0.25 limit, one of the surrounding symbols can be in addition to the first and 
second layers, in the third layer of the constellation points. 

The basic idea for all three proofs is to find all the possible arrangements of the 
surrounding symbols for every given upper limit. 

4.2.2 Reliable Symbols under unknown transmitted symbols 

In blind detection where no training sequence is available, the receiver in the stage of 
the parameters estimation process, does not know what are the surrounding symbols. 
There are two ways to deal with this: 1) to assume a certain surrounding symbols 
sequence and 2) to select the symbols of the surrounding sequence according to their 
received energy. The first way can be implemented when the parameters estimations 
is done in parallel to some trellis decoding. The second way, the more broad solution, 
can be implemented for the parameters estimation just after the demodulation to an I- 
Q plan. For the parameters estimations that are addressed, we'll use the second 
approach. The surrounding symbols selection by their received energy, raises some 
difficulties that will be treated in section 4.5. 



4,2.3 Complex ISI coefficients 



Reliable symbols can be found even when the ISI channel operates in a not 
orthogonal way on the I and Q axes. In the more general form where the ISI 
coefficients are complex, the I axis surrounding symbols have an influence on the Q 
axis symbols (and the same for Q on I). The criterion on the surrounding symbols is to 
be under some energy limit, the real energy of the symbol, that is influenced from 
both the I and Q axis. As an example, for the QAM constellation, where |7S/| < 1 , the 
surrounding symbols have to be from the four lowest energy symbols, the lowest 
4QAM in the QAM constellation. The probability to find a reliable symbol in this 
case is: 



f A ^ 



PR %onstLtion) I^W-l^l (4.11) 



which has 2 



J constellation ^ 
2 J 



times smaller probability than the same limit with 



real ISI coefficients. 

Reliable symbols can be found even under complex ISI noise, obviously it requires 
longer received data sequence length. 

4.2.4 Reliable symbols with control errors 

When the data sequence length is a critical parameter, where just relative short data 
sequence is available, under some assumption, a "noisy" reliable symbols detection 
can be done, "noisy" in the sense that in addition to the "real" reliable symbols the 
system wrongly defines not reliable symbols as reliable. The number of wrong 
reliable symbols can be controllable and made relatively small. 

Based on the QAM demonstration vehicle, upper bound to the probability of a symbol 
to be detected wrongly as a reliable symbol is derived for the open eye limit case. If, 

1. max(|/S7,|) < 0.25, / € n 9 m n,m e k 

2. max(|/57,|) < 0.1667 \fien 9 m 

and the criterion for selecting the surrounding symbols is according to the 0.5 limit 
instead of the 1 limit, then the upper bond on the probability for a wrongly detected 
symbol is: 



P R {error) = P(\ISI * x\ > 1, x e x' ) = P(x e x' ) • P(|/57 * x| > 1 | x e x' ) 

= ITT ' P( ^ ISI * x \~ l \ XGX ')- 2 ' p (\*n\ = 3) • P{sign( Xm ■ ISI m ) = signixn ■ ZS7„)} 
TISI x) = sign( Xm ISI m )} 

+ P<\x q * n , m \ = 3) • P{sign( Xm ■ ISIJ = sign( Xq ■ JSJ q )) 2 
P{sign( Z ISI x) = sign{x q ISI q )) 

= -£—■(-■- + (1--') -) 

where x' is the ensemble of surrounding sequences under the 0.5 limit criterion, 
where one of the symbols is in the second layer of the constellation (the second layer 
under the same scale has magnitude of three). 

The probability to find a reliable symbol is Ar+1 time higher than in the regular limit 1 
reliable symbols detection. In other words, the required sequence length becomes 
substantial shorter when allowing controllable small error events. 

4.2.5 Estimation under received symbols energies 

Reliable symbols are found through a criterion on the surrounding symbols. The 
surrounding symbols are not known in this case, so the selection of the reliable 
symbols relays on the received surrounding signals energies. The surrounding 
received signals are also influenced by the ISI and their own surrounding symbols. 
The question that immediately raises is how do we know that a received signal with 
low level energy has a low-level transmitted energy as well? Generally we can't be 
sure, but when the level of the ISI is controllable, as in our case, following some 
guidelines as will be explained, a low level energy received signal has a very high 
probability to represent a low level energy transmitted symbol A general proof, if 
possible, is very hard to derive. A motivation for the proof is described. We proved it 
empirically by computer simulations. 

Proof motivation: A received signal has a low energy because: 1) Its origin point has 
low level energy, and its surrounding symbols have low level energies. 2) Its origin 
point has low level energy and its surrounding symbols have higher level energies, 



then the received signal in half of the cases will approach zero or even change sign if 
the combination of ISI and surrounding symbols are high. 3) The origin point has high 
energy level and a special combination of relative high level energies surrounding 
symbols occurs. The last scenario is the problematic one, which may include 
surrounding symbols that are not under the required criterion. The probability of 
scenario 3 depends on the size of the ISI and dramatically on the criterion limit. The 
lower the limit the lower the number of combination for scenario 3, which means a 
smaller probability of scenario 3 to happened. In the cases when the ISI is known to 
be very short, as 2-4 coefficients at most, and the ISI or the constellation size are 
relative large, it is required to take more than just 2-4 reliable symbols to deal with 
scenario 3 effect (4-6 respectively, are recommended). 

The central symbol influences on the surrounding symbols as well. In effect if: 
sign{ Xi • ISId = sign(xo) , (4.12) 
Then the effect of the central symbol on the surrounding symbol is: 
effectipn y f ) = -sign( Xi ) • x Q • ISI-i (4. 1 3) : 

and obviously vice versa (concerning the signs), 

where Xi is from the surrounding symbol and y f is the related received signal. For the 
case where the ISI behaves as a symmetric FIR filter, thus ZS7, = ISI-i then when 
Eq.(4. 12) is fulfilled, y. becomes smaller in magnitude, or even change the sign (but 
for limit ISI effect it will still have a small magnitude). Therefore the probability of 
surrounding signals that fulfils Eq.(4.12) to pass the surrounding symbols criterion, is 
much higher than for those that do not fulfil it. Then it is easy to show that reliable 
symbols under symmetric ISI effect have lower magnitude on the average, than their 
origin points. (Actually the same situation happens for just symmetric in sign ISI). To 
deal with this effect the final constellation estimation is done with the subset s of 
reliable symbols. The subset s contains reliable symbols with lower energy, so that the 
probability to have symbols from both sides of the origin points is higher. The size of 
subset s depends on the ISI effect, as it increases the subset contains reliable symbols 
with smaller energy and vice versa. 



4.3 Constellation points estimation (includes the channel gain) 



In blind detection a major estimation parameter is the gain of the channel. The 
channel gain provides to recover the location of the transmitted points, the 
constellation points, on the I-Q plan. The detection process relies deeply on the 
constellation points estimation. Hard decision detection, or the variety of soft decision 
detection methods, use the distance between the transmitted point to the received 
point as a central parameter for detection. Communication through an ISI channel will 
result with symbols exceeding the extreme points of the transmitted constellation. In 
fact the received data points could reach as far as l + Z|/57/j times the maximum 

transmitted points (ignoring the gaussain noise, which with it the maximum received 
data point is even larger in magnitude). 

For the estimation of the transmitted constellation points we assume no prior 
knowledge on the ISI coefficients. The estimation of the transmitted constellation 
points is done in two stages. 



4.3.1 Initial estimation of the constellation points 

Reliable symbols, by definition, have the property that the maximum distance from 
their origin transmitted points are, at most, half the distance of the nearest transmitted 
points in the constellation. Lets again define this distance to be one unit. After 
detecting "enough" received data points, we'll choose the maximum in magnitude in 
the I and Q axes from the reliable symbols set to be the initial maximum constellation 
point in each axis. Enough data points, according to the probability to find reliable 
symbols from the highest magnitude. Let P'maxbe the initial estimation of the 
maximum constellation point, then: 

P l i = slgn(ft. , P 7* -(2|/j-l) - (4.14) 

V consttelation — 1 

is the estimation of the remaining constellation points in each axis, where / is the 
index from zero to each direction. 

(We assume a rectangular QAM constellation. For different shapes the numerator in 
Eq.(4.14) is the number of constellation point for every^axis minus one). 



Notice that while the error in the maximum estimated points can be up to one unit, for 
points that are closer to zero the upper limit on the error goes down to, 

\error\ . < / 1 : P l \-\ (4 15) 

for the points with the smallest magnitude. 



4.3.2 Final estimation of the constellation points 

It is easy to show that, 

P l i=(2$-1)-P l i (4.16) 
when, 

P l * =? l i-p, (4.17) 

where p, is the /th constellation point. Let us express the reliable symbol y* n by the 
origin point plus the related ISI noise coefficient d^- Using Eq.(4. 14,4. 16,4. 17) we.. 
obtain: 

y„ = Pi + d* n = Pi - ^ + rfi = Pi ~ (2|/j - 1) • P x l + dt, (4. 1 8) 

where n is the index of the reliable symbol and / the index of the related constellation 
point. In chapter 2 it is shown that the ISI noise, d'„ can be modelled as a zero mean 
almost gaussian distribution parameter that does not depends on /. Using the weighted 
average estimator over P/ - , where {y} is a subset s of the reliable symbols (Sec. 
4.2.5), we get: 



where the expectation of P x , is: 

1111 (4.20) 
EKj-^TP? -P i ) + E(d n ) = P l l -P l = P i l 

then, 

^.=^. I +(2|/|-1).^ (4.21) 



where { P } are the final estimation of the constellation points. The estimation in 
Eq.(4.19) is done on the first estimation error. Eq.(4.20) indicates that the estimation 
in Eq.(4.19) is not biased. Because {</} is close to the gaussian process, and it is 
known that the averaging-estimator is optimal under gaussian process [15], the 
estimation in Eq.(4.2 1 ) can be considered as almost optimal. 

4.4 ISI coefficients estimation 

ISI coefficients estimation is a crucial stage in data detection under ISI channel. The 
ISI coefficients are essential for the recovering data process, using either equalization 
or soft decision detection as MAP [8],[9], or both. High order constellation 
communication under ISI channel, has a much larger noise level because of the 
amplifier effect caused by the constellation size (Chapter 2). By using reliable 
symbols, in effect, we bypass the high constellation noise effect. In other words, using 
reliable symbols enables to make the estimation under the same conditions as for the 
low order constellation case. 

The estimation method is divided into two methods groups, when the ISI effect is 
known to be under |ZS7| < 0.5 (or under a lower limit) and for the more general case 
where \ISI\<\. 

4.4.1 ISI coefficients estimation for \ISI\ upper limit under or equal to 0.5 

The metric of a received signal from its origin, depends on the ISI coefficients, the 
surrounding symbols and the AWGN Eq.(2.1)). When the SNR is high and the 
surrounding symbols and the desired related metrics are known, then the ISI 
coefficients are simply a solution of k (the length of the ISI window) linear equations. 
The exact solution becomes to be the estimation when the surrounding symbols are 
noisy, then the optimal linear mean square solution is required. In our case, as was 
discussed before, the surrounding transmitted symbols are not known. Instead we use 
the* received signal energies. For: 

y„ = x„+n, si (4.22) 
where x „ is from a surrounding symbols set, y n the related received signal and 
the related ISI noise effect. Under the assumption that a low level received signal 
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"represent a low level surrounding symbol (Sec. 4.2.5), we'll use the general LS 

(weighted linear least square) solution for estimating the ISI coefficients: 

ISI = (X T WXy l X r WA (4.23) 

where, X - n x k matrix where n>k 7 is the ensemble of the surrounding signals for 

each reliable symbol. 

W - An n x n diagonal weight matrix. 

A - n x 1 vector, is the metric of each reliable symbol from its origin. 
Because m S i, the noise on the surrounding symbols, has a close to gaussian 
distribution (as was shown in section 2) and the LS is the optimal estimation for the 
gaussian noise [15], Eq.(4.23) can be considered as close to optimal estimation of the 
ISI coefficients. 

Under a certain constraint to the upper limit on \lSl\ (up to 0.5) at least k reliable 

symbols are chosen under the related criterion (4.2.1. a - 4.2. l.c), where k is the 
assumed upper limit on the ISI length. The metrics of the reliable symbols from their 
origin points creates the A vector. The related received surrounding signals values 
(magnitude and sign) creates the X matrix. Let us assume for the moment that the W 
matrix is a diagonal 1 matrix. The data sequence length is a function of the number of 
required reliable symbols. 

Notice that for the case where the constellation is small enough where all the symbols 
are reliable, the estimation of Eq.(4.23) merges to the regular optimal LS solution. 
The rows of the X matrix are then, the surrounding received signals of sequential 
symbols, as all symbols are reliable. The A vector is then, the related metrics of the 
sequential symbols from their origins. 

The constellation points estimation process uses the surrounding received signals, by 
choosing those that are under some magnitude limit. In the ISI coefficients estimation, 
beside of choosing the surrounding received signals to be under some magnitude 
limit, the estimation process uses the exact value of them (The ^matrix). The quality 
and the limit of the estimation depend on the surrounding received signals noise level. 
From simulation it appear that the limit is \ISI\ = 0.5 . Above this limit the statistical 

LS estimation does not produces valid estimation. Under or equal to 0.5 limit, the 
quality of estimation, like the gaussian case, is a monotonically increasing function of 
the number of rows in the A" matrix, the number of reliable symbols. Simulation shows 



that from k+2 rows the estimation has a very small error for moderate SNR. The 
central symbol, the reliable symbol, has a major effect on the surrounding received 
signals (Sec. 4.2.5). By applying an upper limit to the energy of the reliable symbol, 
we reduce the noise on the surrounding symbols. The limit on the energy of the 
reliable symbols is a function of the assumed upper limit \lS/\ . The probability to find 
a reliable symbol under the additional constraint then becomes: 

a. For \ISI\ < 0.5 it was found that the reliable symbol magnitude can be up to the 
second layer of the constellation. The probability then becomes: 

b. For < 0.33 and 0.25 it was found that the reliable symbol magnitude can be up 
to the third layer of the constellation. The probabilities then become: 

P.-2. ' .(*V(*£L) : | K/ | S025 ( 

V const y V const J ^ const J ' 1 v*-*°J 

The best case is when the reliable symbols are limited to be just from the smallest 
constellation layer. Obviously under such constraint the required length of the data 
sequence has to be longer, two times longer for the 0.5 limit and three times for 0.33 
and 0.25 limits. 

In the case where the estimation of the ISI coefficients is based on the estimation of 
the constellation points, limiting the reliable symbol energy introduce another 
advantage. In Section 4.3 it was shown that error of the received constellation points 
estimation is smaller as the constellation points are closer to the zero. This means that 
reliable symbols under constraint of energy have a more accurate A vector in addition 
to a more accurate^ matrix. 

The W matrix operates as a diagonal weighted matrix [15]. Eq.(4.23) uses the W 
matrix to attach different weights for the different reliable symbols rows. As the 
reliable symbol is higher, up to its energy limit, the related weight value is lower. In 
such way the low energy reliable symbols that can produce better estimation, have 
larger weight in the estimation process than the higher energy levels symbols. 
Simulations have shown that values in the range of 0.7-1 are useful. 




When the ISI channel is a symmetric FIR filter it is easy to show that the LS equation 
requires just half of the required rows, reliable symbols, although the length of the 
surrounding symbols has to remain the same. Fig.(4. 1-4.3) shows the required data 
length 
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Figure 4.1: Required data length vs. ISI length for different constellations. 
\ISI\ < 0.25 
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Figure 4.2: Required data length vs. ISI length for different constellations. 
\ISI\ < 0.33 
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Figure 4.3: Required data length vs. ISI length for different constellations. \lSl\ < OA 



as a function of the ISI length and the constellation size, for several \ISI\ 
for the case the ISI channel is a symmetric FIR filter. 



constraints, 



4.4.2 ISI coefficients estimation for )ZS7| < 1 

It is shown in Sec. 4.4. 1 that when the ISI effect is high and the noise in the X matrix 
in Eq.(27) is high, successful estimation by using the statistical random processing of 
the LS method cannot be carried out. For the case where the |ZS7) is known to be 
smaller than unity, the length of the ISI is up to four coefficients and the ISI channel 
is a symmetric FIR filter, is practically important since it covers most of the mobile 
communication channels. The ISI coefficients estimation, using reliable symbols, for 
these kind of channels is now presented. 

When the surrounding symbols are from the first layer of the constellation points and 
assuming high SNR, the reliable symbols can be placed between five discrete possible 
magnitudes (but not just there), lower than their origin points, with different 
probabilities, for each origin point. Because of the relative high level ISI the reliable 
symbols is limited to be just from the first layer of the. constellation points. The five 
discrete magnitudes that reliable symbols can be placed in, the related surrounding 



symbols set-up and the related probabilities are (for probability comparison we'll use 
the condition probability, where the surrounding symbols are assumed to be in the 
first layer. The probability on the sign is 0.5 ): 

a. The scenario with no ISI noise: 

x n-i = -* n+ i : ' 6 [1,2] => y n = x„ ( 4 27) 

The probability is 0.25 . 

b. The scenario where two anti-symmetric symbols cancel their ISI effect: 
1. 

x n-2=~ x „ + 2 ^ x„-i=x n+ i r\sign(x n _ x isi_ l ) = -sign(x n ) 
=>^=x n +2/ iS 7 1 x„_ 1 (\y„\<\x n \) (428 > 

2. 

x n-\ = ~ x „ + i <^ x n _ 2 = x n+2 o sign(x„_ 2 fSI- 2 ) = sign{x n ) 
^y„=x n +2iSI 2 x„_ 2 (\y„\<\x„\) (429) 

The probabilities for both c. 1 and c.2 is 0.25 . 

c. The scenario where all symbols contribute towards zero: 

= o ■"£"(*„_, isid = sign(x n ) : / e [1,2] 

=> y„=x n +2iSI l x n _ 1 +2lSI 2 x n _ 2 (\y„\<\x n \) (430) 

The probability is 0. 125 . 

d. The scenario where the related symbols to the higher ISI coefficients contributes 
towards zero and the other symbols contributes in the opposite way is: 

n sign(x n _ i isi l ) = -sign(x n ) n sign(x„_j isij) = sign(x n ) 
: / e rmfex(max(|/S7,|) (4 3 !) 

=> y„=x„ +2isi i x n _ i -2 I si j x n _ J <\y„\<\x„\) 

The probability is 0. 125 . 
Notice that: 

2-*nm- (y? + yf) = x min ■ \ISI\ (4.32) 
Where y™ and y" are the reliable symbols that fulfil Eq. (28) and (29) respectively. 
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The estimation algorithm: 

1. Receiving "enough" data points. 

"enough" received data points according to the probability to find a suitable 

reliable symbol: 

»-r , 2 V 

constellation J 

(where, the reliable symbol and its six surrounding symbols are from the first layer of 
the constellation points.) 

2. Identifying a set of relibale symbols {y} (e.g. ten reliable symbols). 

3. Calculating the ISI total effect by 

\ISI\ = L. \SSSL - 1 

LP ' 



max | 



where \data\ max is the value of the maximum in magnitude received data point, 

and l^maxl is the value of the maximum in magnitude received constellation point. 

4. Updating the received constellation points estimation: 

(This stage is for the case where the constellation points are from estimation.) 
Defining the closest reliable symbol to the smallest estimated received 
constellation point (in magnitude) as the new estimation of the estimated points 
that equal [Pj^ . Then calculating the other constellation points in each axis to be: 
Pi = sign® • \P\^ • (2|/| - 1) : / = -k,..-lX--k 

where, 2k is the number of constellation points in each axis. 

5. Updating the ISI total effect: 

Defining the closest data point to (jc)^ - (1 -|/S7|) as the reliable symbols that 
fulfils condition 4.4.2. c. The distance between this point to the first constellation 
point is the updated \ISI\ . 

6. Finding all pairs of data that fulfil Eq.(4.32) (up to some small margin). Because 
there is a small probability for symbols that are not reliable symbols to fulfil 
Eq.(4.32), the set of pairs that appear most frequently, Y, is picked. Then defining 
y s as the smallest, in magnitude, value from the set Y, and y L as the largest, in 
magnitude, value from the set Y. 

7. Estimating the magnitude of the ISI coefficients (without indexes): 



The magnitude of the four coefficients of the ISI are calculated (because the 
assumption is a symmetric ISI channel, actually there are just two coefficient that 
are being estimated): 

Using Eq.(28) and (29), the absolute of the two coefficients are calculated 
\ /SI U» = %^ • K-l = (4.33) 



2-\P . *' 2\P\ 

8. Finding the signs of the ISI coefficients: 

The surrounding symbols of the maximum, in magnitude, received signal, 
\ data \max> are fi * om the extrem e points of the constellation. Because \ISI\ < 1 , the 
signs of the surrounding symbols do not switch in any case. The signs of the ISI 
coefficients are then the same as the signs of the related four immediate 
surrounding symbols. 

9. Last stage. Recovering the indexes to the ISI coefficients: 

Defining the reliable symbols from the set Y, that in magnitude are closer to y s 
than y L , as the set YS. The remaining reliable symbols from the set Y, which are 
closer in magnitude to y L than y s are then defined as the set YL. 
If the set YS has relatively more reliable symbols with immediate surrounding 
symbols with opposite signs than YL, then the indexes of the smallest in 
magnitude ISI coefficients, between \lSl\_ m m and \lSl\_ n n become -1,1 and the 

indexes of the largest become -2,2. On the other hand, If the set YL has relatively 
more reliable symbols with immediate surrounding symbols with opposite signs 
than YS, then the indexes of the smallest in magnitude ISI coefficient, between 
\ ISI \. mjm and \ ISI \-„,n become ~ 2 > 2 and the indexes of the largest become -1,1. 
By using the criterion of Eq.(4.32) we can ignore scenario 4.2.2.d In addition it 
enables to distinguish it from other not reliable symbols. There are some combination 
of surrounding symbols of not reliable symbols that can fulfil Eq.(4.32). Because their 
probabilities are small the number of appearance can be checked to find the correct 
pairs. 
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Figure 4.4: Required data length vs. constellations (ISI length - 4). \lSl\ < 1 



The length of the required data for the estimation is based on the probability from 
Eq.(4.11) multiplied by the probability to have reliable symbols just from the first 
layer in the constellation points. Fig. (4.4) shows the required data length for 
estimation, with eight reliable symbols (according to the probabilities in 4.2.1.a-c), as 
a function of the constellation size. 

Under this estimation for high SNR there is in effect no error in the ISI coefficients, 
and in the by-product estimation, the estimation of the constellation points. This 
accuracy is available because noise is not participating in the process. 
Most of the mobile phone standards, like CDMA and UMTS, use as part of their 
standard, the TDMA (Time Division Multiple Axis) technique. In down link channels 
where the base-station transmit to the mobile, the data rate is number of times faster 
(just for the use as random symbols) under TDMA when using the data of the other 
users. Then the time that is necessary for the estimation process is much shorter. For 
TDMA with twenty users as an example, where 64,000 symbols are required for the 
estimation, it takes less then a second to gather the data. Channel estimation under the 
TDMA standard can be considered then as almost real time process. 



4.5 Adaptive properties 



Wide range of channels have the property that their parameters are varying with time. 
Using the cc ReIiabIe Symbols" method enables adaptive channel parameters 
estimations for time varying channels. The limit to the speed the channel can be 
varying under successful estimation, depends on how fast reliable symbols can be 
found. For continues channel variation, the different estimations can use a "sliding 
window". The new members, for the estimation process are then the new reliable 
symbols with their related surrounding symbols. 

The upper limit on the variation speed is a function of the minimum number of 
reliable symbols needed for estimation (N^L) and the rate of finding a reliable 
symbol (R re/ ). Because in the estimation process the processed data has to be under 
similar channel environment, the upper limit on the variation is determines by the 

product: N'rtL'Rrel- 

The upper limit on the variation is then: The maximum variation where 
N^L ' Rrei transmitted symbols still experience similar channel conditions. Notice that 
whiIe N^L depends on the specific parameter estimation, R re/ is a function of the 
probability to find a reliable symbol. 

4.6 Simulations 

Monte-Carlo simulation was done jointly on the estimation of constellation points and 
the ISI coefficients. The QAM constellation was used with up to 1024 constellation 
points. For evaluation of the estimation performance the ISI filter was imposed on the 
base band symbols. The ISI filters were of the type of symmetric real FIR filter. 
Up-to \ISI\ < 0.5 estimations: The theoretical lower limit on the required received 
data length was confirmed to be enough for estimation for all limits up to 0.5 and ISI 
length of up to 6 coefficients. For 1024QAM under ISI=(-0.05,0. 15,0. 15,-0.05) 
(\ISI\ < 0.4) , (Fig.(4.5)) ISI coefficients estimation was done with an error smaller 




Figure 4. 6: 64 QAM under ISI [-0. 15, 0. 35, 0. 35, -0.15] the edge of "close eye " ) 



" than 10% and constellation points estimation with error smaller than 2.5%, for the 
lowest towards zero constellation point, with 180,000 received data points. For 
256QAM with the same ISI and errors, 10,000 points were enough. 64QAM with the 
same ISI and errors required just 400 received data points. 64QAM with 
ISI=(0.2,-a07,a 16,0. 16,-0.07,0.02) (\/Sl\< 0.5), required 3000 received data points, 
for the estimation process with about the same errors. 

Up to \ISI\ < 1 estimatioins: The theoretical lower limits of the required data length 

have been confirmed by simulations. Variety of ISI length-four channels were 
checked, 

with 64,000 received data points. The estimations for both constellation points and ISI 

coefficients have effectively zero errors. Fig.(4.6) shows 64 QAM with 

ISI=[-0. 15,0.35,0.35,-0. 15] (\lSl\ = 1 ) I-Q graph, where the errors for both estimations 

were zero. Although the lower limit is around 64,000 points, for most ISI channels 
40,000 received data points was enough for successful estimations. 

4.7 Conclusions 

We present a new method the "Reliable Symbols" method, which enables successful 
parameters estimations under high order constellation communication through ISI 
channels. It is shown that the constellation size is acting as an amplifier on the basic 
ISI noise level. Reliable symbols can be found under high order constellation, as long 
as the ISI level does not exceeds the binary open eye level. While there is a limit on 
the ISI level, there is no theoretical limit on the constellation size. Reliable symbols 
can be found under real and complex ISI coefficients. Estimations applications, based 
on <c Reliable Symbols" method, for the constellation points and ISI coefficients are 
derived. The required data length for the channel estimation as a function of the level 
and length of the ISI, and the constellation size are presented. The estimations were 
shown to be suitable for a variety of channels, as the telephone and mobile phone 
channels and for application up to real time tasks. The ISI coefficients estimation 
reduces to the optimal least square estimation for low order constellation. Simulations 
results confirm the "Reliable Symbols" method for the channel parameters estimation 
(blind estimation) under high order constellations/ Successful estimation was 
demonstrated up to 1024QAM. 
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CLAIMS 

1 . A method of high order constellation signal transmission through an ISI 
channel, by identifying "reliable symbols" which are closer to their received constellation 
points or scaled transmitted symbols free from ISI noise effect symbols, than to any 
other received constellation point, and using them to evaluate the channel 
characteristics. 

2. A method according to claim 1 in which comprises identifying a reliable 
symbol as one which has surrounding symbols each having a relatively lower level, up to 
some predetermined distance before and after the identified symbol, nominating the 
identified signal as a "reliable symbol", and repeating the process a number of times 
along the received signal sequence in order to gather a sufficient number of reliable 
symbols to enable a proper evaluation of channel characteristics to be achieved. 

3. A method according to claiml or claim 2 further comprising the steps of 
determining the constellation point locations to establish the channel gain, estimating the 
ISI coefficients, and setting up an inverse channel filter with corresponding parameters in 
order to minimise the ISI noise. 

4. A method according to claim 3 in which an initial estimation of 
constellation point locations is made as: 



Al J- max ro i.i 1 x 

P t =sign(j)— f , -(2|g|-l) 

V consttelation — 1 



Where, 

P max - The maximum (in magnitude) reliable symbol. 



i = -k, -k + 1 -1, l,...k + 1,k. 

where, 2k is the number of constellation points in each axis. 



37 

and a final estimation is made as 



/> = ^ + (2|/| - 1) • P l 



Where, 



P, = 



2i -1 



1 



i = -k, -k + 1,...k + 1,k. 



where, 2k is the number of constellation points in each axis. 

S - The set of detected reliable symbols. 
|S| - The number of reliable symbols in the set S. 
5. A method according to claim 3 or claim 4 for channels up to the level of 

|ISI| < 0.5 in which ISI coefficients for the channel are estimated as 



where, 

X-nxk matrix where n>k, is the ensemble of the surrounding 

signals for each reliable symnbol. 
W - An n x n diagonal weight matrix. 

A - nxl vector, is the metric of each reliable symbol from its 



iSZ = (x T wxr 1 x T wA 



origin. 
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6. A method of high order constallation communication according to claim 3 
or claim 4 including a method of estimating ISI coefficients for channels up to the level of 
|ISI| < 1, substantially as herein described. 

7. A method of high order constellation communication through ISI channels 
substantially as herein described with reference to the accompanying drawings. 



ABSTRACT 



"Increased Data Transmission Bit Rates" 

A method of high order constellation communication through ISI channels, by 
identifying "reliable symbols" which are closer to their received constellation points < 
scaled transmitted symbols free from ISI noise effect symbols, than to any other 
constellation point, and using them to evaluate the channel characteristics. 
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Block diagram of the proposed method in the communication 
system: 



Transmitted 
Symbols 



T 

4- 



21- 



I 



1 



/o 



Modulator 



ISI Channel 



Symbols constellation 
before channel 



/ 



Demodulator 



Z- 4 Symbols constellation 



2o 



18 

\ 



after channel 

14- S 




Received 
Symbols 



Inverse Channel 
Filter 



24 



21 



Channel Parameters 
Estimator 



{ISI coefficients} 

{Constellation points} 
Symbols constellation 

after inverse channel 

filter 



14 



Reliable Symbols 
Extractor 



{Reliable symbols} ^ ^ 

{Releted surrounding symbols 
for each reliable symbol } 



THIS PAGE BLANK (uspto) 




Transmitted Symbols and Received Symbol 

(Reliable symbols method) ISl channel: 
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Constellation Points location Estimation 



• Initial Estimation: 



P?=sign(i). f7 -(2|y|-l) 
V constellation - 1 

Where, 
^ 1 

P max - The maximum (in magnitude) reliable symbol. 

1= -k, -k + 1 -1, + 1fk- 

where, 2k is the number of constellation points in each axis 

• Final Estimation: 



P f = P, 1 + (2|/| - 1) • P l 

Where, 

2i — \ \s\ s 

i = -k, -k + 1,...k + 1,k. 

where, 2k Is the number of constellation points in each axis 
S - The set of detected reliable symbols, 
jsj - The number of reliable symbols in the set S. 
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Channel Parameters (ISI coefficients) Estimation 



• LS Estimation: 



ISI = (X T WXy l X T WA 



For channels up to the level of 

where, 



jisij ^ 0.5 

X - n x k matrix where n>k, is the ensemble of the surrounding 

signals for each reliable symnbol. 
W - An n x n diagonal weight matrix. 

A - «xl vector, is the metric of each reliable symbol from its 
origin. 



• Probability to find Reliable Symbols for different types of 
channels: 



Pr = 2 
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